Path Planning for Multi-Arm Manipulators Using Soft Actor-Critic Algorithm with Position Prediction of Moving Obstacles via LSTM

نویسندگان

چکیده

This paper presents a deep reinforcement learning-based path planning algorithm for the multi-arm robot manipulator when there are both fixed and moving obstacles in workspace. Considering problem properties such as high dimensionality continuous action, proposed employs SAC (soft actor-critic). Moreover, order to predict explicitly future position of obstacle, LSTM (long short-term memory) is used. The SAC-based developed using LSTM. In show performance algorithm, simulation results GAZEBO experimental real manipulators presented. experiment that success ratio generation arbitrary starting goal points converges 100%. It also confirmed successfully predicts obstacle.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Centralized Path Planning for Multi-aircraft in the Presence of Static and Moving Obstacles

This article proposes a new approach for centralized path planning of multiple aircraft in presence of the obstacle-laden environment under low flying rules. The problem considers as a unified nonlinear constraint optimization problem. The minimum time and control investigate as the cost functions and the maximum velocity and power consider as the constraints. The pseudospectral method applies ...

متن کامل

An Actor-Critic Algorithm for Sequence Prediction

We present an approach to training neural networks to generate sequences using actor-critic methods from reinforcement learning (RL). Current log-likelihood training methods are limited by the discrepancy between their training and testing modes, as models must generate tokens conditioned on their previous guesses rather than the ground-truth tokens. We address this problem by introducing a cri...

متن کامل

Efficient Actor-Critic Algorithm with Hierarchical Model Learning and Planning

To improve the convergence rate and the sample efficiency, two efficient learning methods AC-HMLP and RAC-HMLP (AC-HMLP with ℓ2-regularization) are proposed by combining actor-critic algorithm with hierarchical model learning and planning. The hierarchical models consisting of the local and the global models, which are learned at the same time during learning of the value function and the polic...

متن کامل

Local Path Planning with Proximity Sensing for Robot Arm Manipulators

In this paper, the problem of sensor-based path planning for robot arm manipulators operating among unknown obstacles of arbitrary shape is considered. It has been known that, in principle, algorithms with proven convergence can be designed for planar and simple three-dimensional robot arms operating under such conditions. However, implementation of such algorithms presents a variety of problem...

متن کامل

Path planning among moving obstacles using spatial indexing

A method is presented for planning a pa th in t h e presence of moving obstacles. Given a se t of polygonal moving obstacles, we focus on generating a pa th for a mobile robot t h a t navigates in t h e two-dimensional plane. O u r methodology is t o include t ime as one of t h e dimensions of t h e model world. T h i s allows u s t o regard the moving obstacles as being s ta t ionary in t h e ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied sciences

سال: 2022

ISSN: ['2076-3417']

DOI: https://doi.org/10.3390/app12199837